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(57) Abstract: 

PROBLEM TO BE SOLVED: To provide a language 
learning method capable of comparing the voice of a 
native speaker with that of a leaner quickly and 
correctly through the automatic voice comparing 
algorithm of a dynamic time warping base without 
recognizing the voice of the learner. 

SOLUTION: This method with which a learner can 
improve listening comprehension and practice 
conversation of a foreign language by using a computer 
connected to the Internet and also which is capable of 
objectively testing the conversational ability of the 
leaner is provided with a learner's voice signal 10, a 
native speaker's voice signal 20, an automatic voice 
comparing network 30, a DTW (dynamic time warping) 
base difference comparing model 40, an error correcting 
nerve circuitry 50, an expert evaluation comparing 
network 60 and an error calculating network 70. 
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tt-5m2®Pgi: ; atfUWBSM &tf*2a>tttb&ttft<'Ji 
^It&^S^fcrt-BIiflW^S&tfPsl^x 

i*. scroti, WH. X*JHI=*tM6M**jE 
roM$t+»-r-i)fl#PBl^ik^^P '^at/^7> h (for 

■ant) tt«©a * tm-r s jaa»*ik» ? n * * * & u 

[il#*3] ||EDTWJM8tt«*"</l-9-9i: 
#*> -5>3£ * *«Jt«? p v <7 1 . 
2oroe-y^-*ft$SSlto©«#MA>c>*A'5-< > h*— *> 

a >ait«^Pf ^auf»»LfcJHH-v#ttfl>nii-ca*i 

■5 1°— > <t A 'J — (va 1 1 ey) <D*g*t W«P<4M& 
iSfm^&.t/Psl^x h 

5 LT & JWl-r * C £ 

[I**if5] fitIf5^fg©8£Mfti±35i£ftS:-f 

-Ha*««©i*«**Biiiu. *»jtia»K»tDTw 

£JI Cri5#|- «fc •SBtRJl-Jgfci&ISe*)'? 
-tfl/^fflSt. 2«^rof$fi!!'<^^— ©37 U— AS'JS 
^□l— > ij v KSISt (Euclidean distance) IC* y ^ff 
U *«<D»ll^M!&Si*a«*tf»Lr#«>*. Ch 



A— 3>tfa— -r-f £— * — 
^{f^r— » o T # -C3*§#A<S£IS L . 

<h ; 2WPCDM££!!)I-J:<-Jf+«U Jt&l£S£H®l= 

iffES^SaU^PSB-rX 
(D^fil*. 

fc ^fit^. ^> C t t f -&tt3jtlS 6 ISttCD -r > ^ - 

[00O1] 

T- CD § Kl«]^it^;4 ^ ffl L>fcn@Ii^^^RI/P 9H 

<o -9— t* x i z m ? Z> i, <D V Z> „ 

(0 0 0 2] 
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yt#g^si±*-fe-> hf-^t'ftf-^ii:t 

ofcSS^S t>A<fiJBiL^cA < t)^§A < iE5tl-^f'i><fe 51- 
[0 0 0 3] *r*«*«*Stli, e#©*HSH*#l::** 

[0 0 0 4] tl*l=l*B*|II|««"C<D*ma. 
«*tf. *M#©h>fc*f*«6#l*IHI©ft**«l=lt 

ttlS-r -5 *<± t *i fc o 

[0005] «^«-»aaa«*fflt^fc«*Jt« 

(Hidden Markov Model ;iaT. HMMil^?. ) 
X tT-* -O^P i it»-t -5 T ;U 3* >J XAA<IS t A/ if -c 
[0 0 0 6] LfrU 3fi»%*<«2i*tS©**BM|-C* 

[0 0 0 7] 3*g#<D«1-HI§l=a3l*-5©£fl&y <k 

^ISI&aSIWf 67=#>I-I4. T S E (Test of Speakin 
g English), S E P T (Spoken English Proficiency Te 

st) §?<d <£ 5 6*nB«a*. *i^^^f=B#p B isu:ii 

[0 0 0 8] 

[0 0 0 9] *3B!BI4. liiTficPas^ l=IE^T 
rot?*y. *Se33cDBMI4s ■JWBtM? — tf>2"(Dynam 
ic Time Warping:KTF. DTW<tl^. ) aSKDgiS^ 

^i±iS7;u=fyxA$jii:T^s#<D*^$igai-t*-r, 
[o o 1 o] *mw<Dma>smt. — h±<& 

<7>B#fk1£i8F;iT'g#CDrtSi§SE§£$l'LTP^X h 



[0 0 1 1 ] 

fc«>i-**wii. a— 

^g^&lcfclM:. 9MMr*J»fc*— T*?a.fcf— *- 

*<ftg£*U f ffllltf'h* <<t4J:5l=DTWlM 
0) i ftle^ht^;* £ Jfl L^cM-BilW^S&tfPSi^ 
[0 0 12] 

*-rnffii-s^5^TMf*B<ji-uiBj-ri). nil*. *§tm 

\-%%>Hs$—*v h±"C<D*l-Hlf**^»ai/PHlT- 
» L fc :? □ v ^ «RE^IT' fc £ . 

[0013] e»*^it«*-y h7-^T;u=ru 

XA£D*igrofcrtlc % #jt6*lfc-r— : 5* 14*— T--T 

l. m?imtfitmLtz§£ : gmmx-&ho *a. tilt 

I*. 1 ~ 5 3=T? 5 mom ifcffi (discrete value) £f*-i> 0 
s^IB-f-A^S^^+tf-T 1 — 5> (transcribed date) t LT(5 

[0014] H i ics^^^fceib^^itlx^'v hr?- 
— >3o> Jip^if ffltfc&* hr7— > 6oaysitt 

[0 0 15] C<DB#. ^#CD#P1i-^ 1 Ot*-f^ 
fcf— -h— (D^J^m^Z 0\t*v 3 OlC^fco 

[001 6] ^Mtts:^-v vr>— 5» 7 oici*. hp^p 

1ffitt«*-> hr7--> 6 0<Dgfefii«!:gK^tte£^-> hr? 

3 0T'*tbtzitm%im.t<»m&*ibs tommtf*^ 

$ < ^-SJ:?lcli^fiiE#$5lHlSe*H5 0 CD Sj*g *i 
[0 0 1 7] 0 2 14. g)1 ICg|*$HfcDTWSS^tt 

SffiStfcK^E-x^ (XI4D TWSMMitK^ET^^'V h 
1 Ot*-f -f ^t'-*-ffltFff 2 0liDTWS 
hi 

[0 0 18] £"T. "tiiMIt^^7 r ;U4 2ICI*. 
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itt842a^D^t, ttfflBJtSU 2 b^P^ 

<h. 9SftSlttt4 2 c:?D^*<ttS<s*u -£**4x 

[0 0 19] 5££MMttgi4 2 a ^□■y<7-CI*iS#(spe 
aker)l=**«P«#a)««ft*r*< Lfc«. 2f^ 
a>«#WI<DB*#to*o Lfc* 
jS£*-7--f :?xtT— A-SJ&rcSB^* ^y-fe— S?(lin 
guistic message) 0)<?*CDli?:3£#)£;? a % > ^ £ S *_£> e 
B»IB«it«4 2 b^Dy«F|*X*, JUB. **• 
©«*»»B*|lll<D«**«>*^Py*T?fc«sP* BBRB 
tt3&4 2 c?P-^liWt4«tLfc»t*-f^ 
?Xt e - *— ©#^P*<D3l%JU"7> h (formant)<i^M£ 

[0 0 2 0] *M«tt»^ J rJU4 4tt/3t»*i*-C** 

ftS:^E^;U4 4ICI4. 3£i£ (stress) MitK 4 4a?P-> 
£ -f > h*-va >(intonation)MJ±©4 4 b 3?P 
£ & . 'J XA (rhythm) ^J±g* 44c?P7? A^tt* 

[002 1] £(DB#. WBW*^^ 4 1*. 

x-f ^Xbf— *— #^a>tT!y^*MM(l (pitch conto 

* -©*^T?»im i= * £ tr ^ f»«sR#© e ^ * 

^B*M*-C«*tr—2 (peak)0CD««MfcttffiS£#tf> 
S^P^^-CfcSo -<> h*— >3>*it»4 4 b^P 

^-ezooe^^itlBttott^^&sRtoi^p^^* 

TFLTfcy. ijXA«Jttt4 4c^P^^I*««Lfc» 
H***0)IB-ca*L-6 tf— £ — (val ley)<D*g*tM 

tt(4«ai/*#** x 'bW-«**t*^p 

[0 0 2 2] SftfECflJ: 5<fD T WgffiMlt&t^ET^U 4 O 
O0)*n*»«»«fcH:tt*^«TWricl**aiE#|8ElB 

Jb*,. D TWiiittg* 7 h 9-^7 4 00 6 

lEWSESSISS OCD*gig£ LTI4. 2 Ji(D ^Hfltify 
ir^P KV'ExJKMulti-Layer Perceptron) tfiMfB $*t 

So 

[0 0 2 3] e»**ittt*^ h9-*(D7;^ 'JXA 
ftKStu fi#ElBffl*^ h9- ^0)->+^(synaps 



2^ s F£Di£^§|gfc(Mean Squared Error Function) tK 
§&fcg^g7;UP 'J X A (Error-Back Propagation a I 
gorithm) ^b4*4o 
[0 0 2 4] 0 314. HZlcH^tlfcWBSttK^E-r 

fc5l*Bmfc«^n^^©BJiSltiB*lftB-r*fc* * 
—if <(7X\£-t>-£ 3*S%*J»<DB * BJIttltttXO 

?*tr— a— (d#wi#s 1 o o-ex> KdSttuis i 

02L, ^S^CD^fl-^S 1 O 1 T?tX> Kjft^ftUJ 

S103L x*;u^f— flUMb^a ^S104 £il 

iLfcS, 7l/-A?D«^fcS10 5, S106L 
t7-'Jl^S1 07, S108£*T?o C<DB$. 
9U-A?P7^1bS1 0 5, S 1 0 614. Et^lJClA 
1 J (m i 1 1 i -second) T'^hK /\== > 
(Hamming window)^/\x>^Jg (Hanning window) $■ 

[0 0 2 5] 7-'JlSSSS 10 7, S 1 O 8 

■MKft D TWMttB#K***tttl»4t4 
WrlW-BaRMM^ — tf >y S 1 O 9 Lfcfc. /<— * (B 
arWmtt-crowa*^— tf>^S 110, S 1 1 1 fc. 
^ K^x (Loudness) »f4-C0)3iS 7— tf>^S 1 1 2 
2, Si l3iBS*I4^i:i:ft4o 
[0 0 2 6] C(£B#. l»ra-«5K»»M7-tf^ys 1 

0 9 14. *-f -f ?Xlf-*-OWt«Wf W 
IH*CB»<D*l=J:*je». ■**&*>*>. **i#tt(duratio 

[0 0 2 7] A— <? (BarMWttTOnXflt 1 ? — t°>^S 
110, S 1 1 i 14. 'MU'VH z fiitD^^I^S^g 
i&a* W (psychoacoust i c) JS&S&i^ti: T* fc 6 / \— 2 (Ba r 
k)*ffilzfc7L*«#-e&4. 5* K*X (Loudness) 
T*tf>3££ r 7— tfl/^S 112, S 1 1 314. 9-'JX^ 
^S107, S 1 o 8 SIttUlt#fcx^ k;kdi 

[0 0 2 8] 7-'Jl»SftS1 14, S1 1 5Lfc 
ffc. h^A(cepstrum)ft®^P S 1 1 6, S 

1 1 7lz«fc-3r«»Mlc>r^x 

ft-f £o 7 — , Jxi»Sfts 114. S 1 1 5 

14^ K*^»ttB*^ — tr>^*ffofc«#a&<SIBktt 
^»y. «frFMT'fe^CDt?. =3+r-<>^^<Cosine tran 

sf orm) \Z ct y fta-r ^>sp^t- 4 o 

[0 0 2 9] -r-f ^Xt°— <D*^«#S 1 O O 
<b:^g#CD^^<t^S 1 O 1 T'hb^^ti^^^X h^A 
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ft©*??— G^Zf* r-^Af+S^O-;/^ S 1 1 6. S 

1 1 7ir«krjTftfie<)l-ttt±i-r-5). Z<D^. ffttZLtz* 
f|B^(0^;il*> H#0> P L P (perceptua I linear predi 
ct i on) !»#®ttai^a <t mm? S ^^ft-§-<DES#!f$tt 

-r s £ s i - m ft t £ ib - h at a is w - tf > $ r :? a -v 

1 0 9A<gil,<iiao£Hfc£lcfc(t6S*<fc-5>o 
[oo3 0]^t. :7U-A&js§gt£f+g:Lfc&s i 

l. s§itMa>fiS£fcBLT 2-g;§<z>2ri ; ^fiii::-f s„ 
[00 3 1 ] 7 1/- A»lffi«ltt*5 r n'yf s 1 1 

*n f> 5 £ T'CD* £ $ £ *f -i> <fc 5 lc^g|(D!S £ SRtf-ir 
■7*P-V^S 1 1 1 -Q^m^W^^Oiy^ ^ ->>7 7>(logis 
tic)£&£ffll^T^&-f So 

[0032] 114 1*. m3\zmi*2titz8fr<ii-m>6.§SL®i 

0i¥fft^2O1tt. C+L<i(D'!r^X H^A^a^ 
•J7 £ —CD 7 U— Agijffigt A<«/Mc3tC S «fc 5 I- , B#Pb1 £ ^ 

^2 o ot©«#n*i««*jii{<-rfctou. ^MtfiiMn 
far?— tr>y 2 o 3 ^jiig-r-So 

[003 3] f LT. ^7°X h^AftHS^^-^ttiii 
«?D'^2 04, 2 O 5ICA l J . -tr7°X h^A7b<It 
7U-ASiJS§gltt*7"D-y> 2 0 h 
^A^??— 7 'J KS§gfA<ft®:£*tSo 

B#. C ©«« *<ft/JM= S «fc 9 l=*JB« *» 7 - tf V 

2 0 2 £!M£«2E)e<lB#RS]'?— e >-7*2 o 3 tf'nfrtiZ. 
[0 0 3 4] -f5. 0 2<7>B#fBlM£tix4 2b?D^9 

I*. H4©B*IW-JB**ttWr7-tf>^l=«fcoT»+»S 
^tfc^W#i: -f 7* tf— 2> — $ — T-B# 

•So -r^^*>, B#F B 1lftlrTS5iJ$+vfc2 ; g-^iI#(75 i g-^ 

filA^ffflgJt^ 4 2 b -Ju y^(DtiitimzU^ 0 
[0 0 3 5] Ztltmm~* E2T?S;£l£Mltg£4 2 c 
7a v V I*. fiilfB(DB#fV]ghfc3Sc 42b^O'^ T***/= 

#*><jt§ Ltz^t r -c 7"* tf — 1>— (D^prsio)m 

1 *;U"? > h F 1 . m 2 >t-F2. 13 > 

r- F 3 ^(DfiEM *v t> i+Sf S = 
[0036] D5 a71»M5 c I*. Ill 2 



ir. 2^^<i-§-OTfi1t^l*. tf <v5 L *iS8tla>gfrt.f+S 

$;h.sa<. ^^roe-y^iiKtsrosassfe^-c^f y 
&\z j: y t «i«»*-ef© tf v ^itw«4<« 

[0 0 3 7] H5 a ^iftfSB-f *— ^.f tf— * 
oTsSLfc^^-CfcS. 0 2<Dl$?»gtt$3U 4 a 

^-?ict. tf-v^life^-es^tf-^A<a*tS^iii^mi§ 
*<, F^itofcas$2^<D^^ST-it^-r-So -r^*5 

[0 0 3 8] 115 b ^l&BJ-rai:. H2W'f>K^— v 

stf-v^ii*s^ro<®#MA^ett^:$*tSo -r«*>*. # 
-c?fc y . . ^xcDii^iot^ttwi-ia^iiiEgitic/d: So *u 

[0039] H5clot, H 2 <D 'J X AMtklx 4 4 c 7o 

v & ifts^-r s ^7 7 r- $> y . 2 e v TF$i$B«St? 

= W©e-^^^LT6 l J. j£H^ff$l*/\*y— (val le 
y) ^ ^ L T L v S o 2 * JB(0 'J X AMI*S!lie L fc tf — ^ 
/ %• y — (73<liS <t * # $ <DM^ t, #*> S - t *<ttJ * S o 

[0040] Dei*. ^mwizmzH-mtm^^ziv 
u-e&s. H6icrg]jjt$^fcjt M-sssfs^^sa 

hcDf=toC7D+)— /\— =l>tfi— 3 O Oli. 
HUie-y— /<— =i>tf a-— 2 3 0 irS^^H/i'T * 
h 3 2 OilSgffl. WIE-f M2 031^*3^ 

^LtSSt§ma>ea-^ 340a, 3 40 
b, ■•■t?If3 60a, 360 b, ••■frt.&Sv'X 
f Afife'S. C0)ffiJ. ^ff 3 60a, 360 b. ■•• 

i*#^<I^^SS#> iS^-e^S^aicv^gBtxtf 
-*-£*r-tSo 

[0041] 17 it. 3>tfi— $* t-y— /<— 3 >tf a. 

— f Pel T'^T^tv S - a<75 -r— 5» ffi^igfi ^Lf:t«)t? 
fcS. 117 ali, ^^#3>tfi — ^r*^gp^(DT;u=f 

yXA*<«as$^rfcy. 117 b-rjii-y— /<— =i>tf^. 

— ^T-^g|5»<DT;Ua 'JXAA<5aS$^So *T\ H 7 
a^lttBJ-r^i:. ^g#zi>tfi— ? 3 4 0T-I*. "7*f 

•§•3 4 2 t*— /N*— 3>tfa — ^ 3 0 OCD^— T"-f 7"^. 
tf-Tl-^^^T-^ 3 0 2frb«SSi$L 

<fe => it^^-f^ tf-73— g-^<I-§-3 0 4^7 
r§t> SiifE^Jt^T^^ 'JXA3 4 4lC«J;or 2"& 
jS<D^£l3rtHbL. ^ttScS^T-f ^^"U— 3 4 6 7" 
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[0 0 4 2] *f=. f-/i-3>fj-$3 00fll 
^-f -f t"-*-fflf Pl^f ^-X 3 0 2£ 

^^-^..y h$^Lt¥If3>fa-$ 3 4 0IC*- 
?X 3 4 2 £iH£o 

[O0 4 3] 3*1*1?. 07 b £tftBJ-f -i. <t . 3*§#=l> 
fa-5i3 4 0fli. Mf£iifltl^i:<. 
r^ottfc¥Sf©a^3 4 2 £+>—/%*-=> >t? 
i— £ 3 O OI-iMy. *-f-f^t!-*-f^(iff 
— ^/<— X3 O 2frt>®^Lcfc'5£:-f -r-f ?Xtf 
-*-^(t#3 0 4^jM«-r^ 0 lilft. gKlfB^JtSe 
T;U=f'JXA3 O 6T'2$^OMA<tfefiHb$*t^§#3 
>^a- 'S'CD^ht^S^-f^.rf U— 3 4 6|C^t.tl 

[0044] B8I£» **«©*J6ffiH=«4WBB«* 

^«iifi$5FLfc3it^siT*&i)o hi 8 &mm-rz>t. 

+ h _ /N -_ =]> ei-^l-^-r-i)IS:PiS4 0 0<!: ; 

-/ & ««( $ *t*«ft©**«H *>"*• 'J *<7> * 
^Mrov-^-'J^^S^-r^SPgS 4 0 4 <t ; m&.2*ttz 

-SlSPgS 406i ; i£S#ett<B5iSW£8W-r&f8:P&S 
408t; 2*^0>a*a»l=J:ytt-*L. lt*M6*£ 
EBlc-?* X^U— -r*IB:BS4 lOt; X*IB*ttV 
S««-rft]^**JK-r4«PltS4 12t; ffT*H9:tt4 1 
Of, til<t:5ttiii^ ifl)->t'J*"COTt4 
j^0>nJ5£3i#?-f -SfSIgS 414t £fil*.-5o 
[0 0 4 5] H9I*. ^BJO^JS^JI-^-S^llII^W 

3>t*a— ^icBBLTetfflDrtBBB****^ 

OOi; ^#A^^-Wt»$S$ A*|-f -S>I£P§S 5 0 2 
^S^S^-T-SfSPgS 504t; jgJ?$*ifcltSJtXSE 

i-*fL. x-f ^if— «a*s 

506i ; ^S^A^^rofE^^it^-r-SfSPgS 5 0 8 

•v^-r -siangs 5 iot; &.vm<DM%fg.<Df£imT'nv 

=f*. h^^T5A^S«?-r«)ePgS 512t; Stf*B# 
[0 0 4 6] 



[0 0 4 7] -O. SSb^tt&T^a'jXA^x-;/ 
ea- frtyfl-BBStfMMBfc P^X t-A^jt-Stt-BB 

jjsg-y— e x £ti <a-r c t ic j: y . mmm^m &m\- 
±i£&tiE-t -set 

[EM] *f|B^|z^-6'T — *•;/ h±-C<DttBB5S 

? T)Vd ') XAO) 0 *#fi)cElT-fc-i>c 
[El 2] El 1 izmyjiZtit-mgh^Pttm-v K9- ? 

[i3] mzizm^^titzmmmvrU^^^X'^m 

[El 4] 0 3l-EI*£;h.fcB#P B T-J§;£S&»)6*jr7-fc o > 
[15] 5 a7!)S5 cl£. El 2 l-EI*£;t^/•:: ; §•fIMft 
[16] **wicff*nB»fe**«itfpaii-T-^ k 
[17] ^B^icsi)^^#=i>fi— -> t-y— /<— 

[El 8] *36W©SH6«l=«**1'HBJ6#^«a)iae 
[El 9 ] #f£BJOTH]6£0iJlc&'Stt@t§^#PEl7 i X H 

[S#(75lftB^] 

1 0 ^#^Wt^ 

2 0 T- -f ^X t°— ±) — W^d-^ 

3 0 SKlWUttt** h9-<7 
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